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SUMMARY 



' This a research study of a demonstration- project in 
which the Graham Associates (GA) attemjfted to show that their 
New Education Program (NEP) could provide effective learning 
experiences in a variety of situations butside the schooling ' 
mainstream. NEP, an adaptation ajid refinement of the Job 
Corps Programmed Learning System, was used and researched An 
two Neighborhood Youth Corps programs tone in Long Beach £uid 
one in Spokane), In two juvenile detention facilities (one - 
minimum, and' the other maximiom security) , in a class of 
underachieving^" ninth graders, and in an- MDTA skills center. 

Study design o ^ 

The evaluative data consisted of reports on each NEP' ^ 
student on enrollment, during enrollment and bn termination 
from the NEP. Th^ stjidents were given reading and math achieve 
ment tests on entry and at three-month intervals for a, maK- 
imvun^of three retests. Teacher reports were obtained on 
entry, at^ the end of ^ach month of participation, and at time 
6f termination. Students' views of NEP were obtained after 
the program had been in operation for three months. 

These data, together with observations of teachers and 
of the demonstration and research staff permitted the apf^li- 
cation of the following achievement criteria: 

-Improvement in reading and math achievement test scores 

* 

-Quality of NEP participation 

-Outcomes or sequels to NEP participation indicative 
of achievement . 
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Data collection began in the fall of 1973 and ended in 
1974 With 528 subjects included in the study. The average 
schQol grade completed in the six study sites ranged from 
the eighth to the eleventh grade with the average for the 
total study group about 9.5 grades. The average age ranged 
from 15- to 18 for all sites except the MDTA Skills Center " 
which was substan£ially higher (25.3 years). The juVenile 
\detention sites were 100 percent male while .the MDTA Skills " 
Center had 75 percent females. The other three sites had 
about an equal number of each sex. The majority of the 
students were white, but substantial proportions were 
black or Chicano, The percentage of whites ranged frcm 
84 percent for the 9th grade class to 35 percent for Long 
^ Beach. The percentage of blacks ranged from 45 percent for ^ 
( Long Beach to 2 percent for the 9th grade class. The per- 
centage of .Chicanos ranged frqm 35 percent for the MDTA 
Skills Center to 8 percent for Spokane. 

Results , i 

The re&ults varied depending upon the site but some 
significant measure of success- was achieved in all sites. ) 

. Juvenile detention facilities • | 

A significant gain in both reading and. math test scopes 
was achieved at the 'end of three months (about three four.l^hs 
of a gi;ade level) , The progress did not continue during , the 
second three month period. This lack of progress was proba- 
bly due to the fact that students who stay in detention faci- 
lities have poorer motivation- than those who are released 
early. Nevertheless the NEP program would l/e strengthened - 
if its appeal to such students could be improved. 

» 

Ninth grade class 

Since the NEP. program was scheduled for only one semes- 
ter at this site^only one retest was possible. Tl^ gains in read- 
averaged a full grade lev^l while th« gains in mathiwere only 
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.4 grades reflecting perhaps, the greater interest of the 
teacher in the reading program. At this site the same 
teacher taught both reading and math. 

MDTA Skills Center 

The primary focus of this site was to prepare partici- 
pants for jobs and only a small number stayed at the Center 
long enough to be retested. All of the retested students 
were in the Math Program and at the end of three months they 
averaged a gain of on^ grade level. The quality of the parti- 
cipation of students who were not retested appeared to be 
good because this site had the highest average ratings by 
the teachers of student interest and student progress. 

Two NYC-2 programs 

The Long Beach and Spokane NYC-2 progrcutts provided solid 
evidence for NEP effectiveness. Average progress during the 
first three months of participation was almost one grade 
lev^l for both programs with an additional one half of a 
grade for the second, three month period. In Long Beach, 
^he only program which was able to test student^ a third 
time, the rate of progress continued with a little over a 
half year gain during^ the third three month period. The stu- 
dents who participated in NEP for nine months and were test- 
ed three times, gained an average of 1.9 grades in reading an 
and 2.2 grades in math. 

Another possible measure" of program effectiveness, 
which is only relevant to the two NYC-2 programs, is its 
holding power. In both Long Beach and Spokane, the NEP 
demonstrated good holding power. Students who left^the pro- 
gram before being retested left primarily because they had 
completed high , school, passed the GED or had obtiained a job. 

The two NYC-2 programs were al0o exceptionally success- 
ful in helping the students complete high school or pass' the 
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GED, with the percentages ranging from about 43 percent in 
Long Beach to ab^out 53 percent in Spokane, This hi-gh rate 
of success was due ?.n large part to the ar rang omen t;3 made 
with local school authorities for the crediting of completed 
NEP units toward a high school diploma, ^ 

It was concluded that the New Educational Program 
developed by Graham Associates is effective in providing 
remedial education to • underachieving adolescents and adults. 
NEP had been used in an earlier demonstration project and 
the design had been modified based on what was learned from 
the earlier project. The revisictas in the design were. found 
to make NEP fnore effective, Several ways in which NEP 
might be improved are discussed in the body of the report. 
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INTRODUCTION 



In the fall of 1973, th^^-Gx^aham Associates (GA) of Wal- 
nut Creek, California,, under^ok a project designed to demon- 
strate that their New Educat4>on Program (NEP) could provide 
effective learning experience to persons in a variety of 
situations outside the schooling mainstream. This project 
grew out of a similar undertaking in 1972 (NEP-1) in which 
NEP was used in four California Neighborhood Youth Corps 
^programs. In the second project (NEP-2) , the subject of 
this report, NEP was used in two Neighborhood Youth Corps 
programs (one in« Calif ornia and one in Washington), in two 
juvenile detentiorr facilities (one minimum, and the other 
maximum security) , in a class of underachieving 9th graders, 
and in an MDTA skills center. 

NEP is based on the Job Corps Programfned Learning 
System, materials from which provide its core curriculum. 
NEP projects are installed and monitored by GA; and duccess- 
ful solutions to problems of operation and of materials, 
developed through NEP experience, are incorporated into 
existing or new projects. 

Manpower Research Projects -<MRP),.of 'fhe 'George Wash- 
ington University in Washington, D.C. contracted to study 
the effectiveness of NEP-2 — a role that it had also under- , 
taken in connection with the earlier GA demonstration pro- 
ject. In both NEP-1 and NEP-2, two kinds oj^ rep^orts were 
generated: GA operational reports and MRP research reports. 
Although some operational information necessarily is in- 

^ Y. A more detailed description of the New Education 
Program is contained in the Appendix. 
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eluded in MRP reports, research reports are focused on 
the information necessary to the evaluation of NEP effec- 
tiveness. a 



Study design 

The purpose of the NEP-2 demonstration projects was 
to determine whether NEP, already tested in four Neighborhood 
Youth Corps projects in California, could be succes^fully 
adapted to a wide variety of settings. This study was de- 
' signecj to permit the evaluation of NEP-2 achievements i<n 
t terms of academic gains and other measurable outcomes of 
^ NEP -2 experience . 

The major evaluative' data consisted of reports oh 
each NEP student on enrollment, during enrollment and on 
termination -from the project. These data were supplemented 
by on-site reconnaissance, conducted by MRP staff, and by 
reports -provided by GA. \ \^ 
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student data included: 



1. Results of academic achievement tests on entry and 
'at three-month intervals for a maximum of three retests. 

2. Student (Characteristics on entry, monthly reports of 
students* participation (attendance, interest, progress), 
and termination reports on the students by their teachers, 

.3. Students' views of NEP, structured through a short 
information form, used from time to time in each site 
project . 

These data, together with the observations of teachers 
and of GA and MRP staff, permitted the application of achieve- 
ment criteria. The principal achievement criteria were: 



1.' The data collection forms used in this study were in- 
corporated in the first Progress Report (October, 1973) . 
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vJ*, Improvement in academic test scores 

"'2. Quality of" NEP p^articipation 

3. Outcomes or sequels to NEP participation- indicative 
of achievement, , ^ 

' The variety of settings in NEP-2 necessitated somewhat 
different criteria emphases in some sites, in the two 
detentjjon sites, for example, attendance was compulsory 
knd was of little value as anV achievement- criterion. In 
the MDTA skills center /.\o cite anotl^er examplje> many of the 
students were high school graduates and 'the academic achieve- 
ment criteria of^a high school diploma or passinq.-i:he^GED 
(high school equivalency test) were of less valuk than they 

\ 

Scope and plan of report 

The education system deveroped by tSraham Associates ang^ 
its operation in the several sites of this, study has been • ' 
reported by them;"'' and the first phases -of the NEP-2 study 
have been fully described in an earlier research report,^ 

This final* report on NEP-2 briefly reviews the charac- 
teristics of the various si^te , projects in the following 
chapter. The achievements of the^program are examined i^n 
Chapter 3. 



1, Enright, William J,, and Graham, Gary S, The 
Developmient of a Comprehensive Basic Education System fo r 
Alternat ive Education Programs , (Springfield, Va,: National 
Technical Information Service, 1975) , 

2. Walther, Regis H, , and Magnusson, Margaret L,, . 
A Study of the Effectiveness of the Graham Associates ' 
-Demonstration Project on Education Programming in Manpower 
Training Projects , report no, 2: The First Months, (Spring- 
field, Va.: National Technical Information Service, 1974), 
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X . NEP-2 SITES AND STUDENTS 

f '■ ^ • ' > -• 

The purpose of NEP-2 was to test this education pro- 
gram in a variety of settings where students were outBide 
the schooling mainstream* NEP-2 sites, briefly described below, 
amply satisfied the purpose of providing a variety of settings 
for program demonstration- . 
BvrOn>^QVs Ranch * < 

A minimum-security detention facility for male juve- 
niles, Byron Boys Ranch in Contra Costa County, California, 
was the first site to be started in NEP-2. Byron's existing 
education program, apparently adequate in terms of facilities 
and staff, was recognized to be educationally iifeffective for 
many of the boys. NEP-2 was installed in an effort to im- 
prove the facility's education component . 

The NEP-2 start at Byron principally involved the pro- 
vision of materials, training the four experienced teachers 
in NEP-2 methods and procedures, administering initial tests • 
to 55 new NEP students, and wotking out NEP, credit arrange- 
ments with schopl authorities. ^ 

Pre-P^acement Center / * 

- A related maximum-security detention facility, the Pre-' 
Placement Center at Martinet, California, was set up as a 
NEP-2 site in December, 1973 — about three months after the 
NEP-2 start at Byron. The Pre-Placement Center (PPC) 'is 
used by Contra Costa County for the detention of juvenile^ 
whose behavior has indicated that tjiey need to be "locked 
up." Boys who "run" from Byron- are usually detained at PPC 
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when they are again in custody; and boys at p/c who demon- 
strate g^od behavior may be transferred to Byron. 

The NEP-2 PPC project began with .seven students and with 
an already-trained teacher from Byron. * 

Because many NEP-2 . students in Contra Costa County/" 
were both at Byron and at PPC in the cpurse of their enroll- 
ments, the two facilities were treated. as a single research 
site. The setting of NEP-2 education at Byron, howevfer, was 
distinct from that at PPC, 

At Byron, an inmate's day was divided in half by his 
activities: either work in 4:he morning and education in the 
afternoon, or vice versa. Education was -conducted in two 
large classrooms separated by a small combination reading 
laboratory and resource room. The space was well-arranged 
for,NEP activities, with numerous individual study carrels 
and several tables for group work. 

At PPC education was carried on with the students in 
their individual cells, because it ,wa&> founcj that fighting 
broke out whenever the students assembled in groups. The 
privacy of PPC NEP-2 education may have improved the per- 
formance of PPC students in that no student was embarrassed 
by public (classroom) knowledge of his academic deficiencies; 
and, freed from social situations triggering defense mechan- 
isms, he often worked well for lack qf anything else to do. 

At Byron-PPC the length of an inmate's detention was 
determined, to some extent, by the quality of his behavior 
and attitudes. Inmates whose "good behavior , including their 
good behavior in NEP, indicated that they could be trusted 
to behave themselves if undetained could expect to stay a 
shorter time in Byrt)n. 
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Pacoima Skills Center 

In Noveniber, 1973. GA started a NEP-2 project in a large 
MDTA skj,lls center in Pacoima. California. This center has 
the reputation of being a -job factory." placing its emphasis 
on getting its students into jobs as quickly as possible and 
correspondingly deremphasizing the usual education compo- 
nent of MDl-A installations. In the fall of '73. the princi- 
pal • of the skills center had begun to "beef up" the center's 
education' component and had hired a skilled and experienced 
teacher for the center's "learning lab." \t_Wiis point. 
GA and NEP-2 were brought in. 

The installation of NEP-2 in Pacoima required about ^ five 
.weeks, or more than twice as long as the normal start-up 
period. The reasons for the longer time in Pacoima included 
the facts that (1) the teacher was already at work and had 
little time for^her training. (2) the needs for education . 
were as variegated as the vocational c6iirses of the* Center 
(multi-clerical, automotive, welding, production machine 
operator, and^.landscape) and (3) the study lab classroom was 
ill-arranged for NEP-2 .education. 



^"^ °^ installation period, the study lab 

had been reorganized to comfort^ably accommodate students and 
NEP -materials, and two kinds of learning settings had been 
added to the study.. 

Both of the Pacoima study groups involved math only.""- 
One group of Pacoima math students was composed of multi- 
clerical trainees. The regular teacher of these students 
was trained in the NEP system, and clerical math students 
were required to attend three one-and-a-half-hour clashes 
per week. Virtually all of the clerical math students 



were women. 



The second group of Pacoima math "students wag composed 
.of . trainees, most all of whom were men, in Production Machine 

iL, 1. A reading program was installed but the students did 

5it; not stay in the MDTA program long enough to be retested. 

i. >* 
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Operation, Landscapin'g, Welding, *and Automotive work. , This 
group Vas under the study lab instructor, and attendance -vas 
voluntary. 

Compared wrth students in other NEP-2 study groups^x 
Pacoima students Vere older and better-educated. The usual 
academic goals of wEP (achievement of high school credits, 
including high schobl diploma, or preparation for the GED, 
including passing tnte GED) were of less importance than in other 
sites. ' ManV Pacoi^ia students were l:iigh school graduates, 
and all were primarily interested in the improvement of job- 
related academic skills. 

Spokane NYC " ^ 

Two study dites were in out-of -school Neighborhood 
Youth Corps (NYC) ^ projects which were designed to serve *, 
'16- and 17-year-old dropouts. The first of the two NYC 
NEP-2 study groups was st>^rted in Spokane, Washington, in 
January, 1974. 

Prior to the advent of NEP, t^ educ/ation of Spokane 
NYC enrollees had been provided a c^fit inu^tion school^ 
or in the NYC ' s own GED-prep progl^anu Both of these educa- 
tion resources were deemed undesiraK^^ or improvable: the 
pontinuatron school, located on thelre^ttj^ar high school 
campus, had a generally poor reputattlon; and the NYC ' s 
program, located in very cramped quarters, offered only 
GED preparation. The Spokane NEP program was designed 



1. The term "NYC" has become anachronistic with the 
elimination of categorical manpower programs in 1974. Former 
categorical programs are now funded under Thjs Comprehensive 
Employment and Training Act (CETA) . 

2. Gontinuation schools are facilities provided for stu- 
dents who have been terminated from regular or standard 
schools. Populations in these schools are composed of "prob- 
lem" students. The resultant demands on the education sys- 
tems in these schools are such that the education provided by 

^tJontinUation ^schools tends to be inferior. 

/ 

^ 17 • 



to serve NYC ehrollees who had formerly used the continuation 
school as well ^s ;to serve GED studeftts. The implementation ' 
of NEP in Spokane involved finding new quarters — a renovated 
ex-laundromat with furniture provided by the community 
(SQllege — and the expansion of the NYC teaching staf'f to ofte 
half-time, and two full-time instructors, also "provided by 
the College District. . ft^ in other NYC settings, Spokane NEP 
classes ran in three-hour morning and afternoon sessions, 
with students scheduled for approximately 15 hours a week. 

/ ' ■■■ 

NEP-1 experiences had established that the crediting of 
NEP work towards a high school diploma increased the effective- 
ness of^ NEP vith high school dropouts. NEP-1 experience, 
l^ited to California, had shown the feasibility of arranging 
for scl^ool credits with local high school districts. In 
the state of Washington, it was found that Community College 
Districts have gre^t flexibility in granting high school 
crelflits^ f or work done in "special schools." Arrangements 
for the acclreditatl^ of NEP achievements were, made with 
the Spokane Falls Community College, whose ^administrators 
had been most receptive to the NEP and who readily accredited 

the program. 

• I, 

Long Beach NYC > " 5 - 

The other NYC site in the present, study was started 
in March, 1974 in Long Beach, California. Although the 
Long Beach NYC listed eight potential education options for 
its enrollees, approximately 85 percent of the Lori^. Beach 
enrollee^ were served by two education sit^s: the contin- 
uation school and the Learning Centers o£ the Youth 
Deyelopment^Project (YDP) . The Learning Centers, first 
developed iix 1971, "installed NEP in February, 1973. The 
Long Beach NEP-2 involved the^ Learning Centers, 'and the 
Long Beach NEP-2 start involved the updating of NEP-1 
methods and materials, and adding the data-collect ion pro- 
cedures required by the study. 
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When NEP-2 was installed in Long Beach, studjents al- 
ready in the Learning Centers became study subjects". The 
.'test/retest cycle of NEP meant that some test results 
prior to a NEP-2 start were available in Long Beach. Al- 
though Long Beach was the last NEP-2 start. Long .Beach test 
results were more extensive than thase in other sites. 

There are two Long Beach Learning Centers (LCs) : 
LC-2 is located in the black central district, and LC-3 
is located in the downtown area. Each is a store-front 
operation, staffed with a teacher and a teacher's aide, 
and acqomodates 20-25 students. LC-2 had lost its teacher 
shortly a^f^er the NEP-2 start, with the former teacher's 
aide moving into the vacated position, cind a new teacher's 
aide being hired. LC-3, on the other hand, retained its 
NEP-1 teacher throughout the^study although a new teacher's 
aide (a friend of the teacher's) was liired at about the time, 
NEP-2 started. The staff of LC-2 was black, while th^staff 
of LC-3 was white. - . J* x 

Credit arrangements with the local high school district, 
allowing students to get high school diplomas for Learning 
Center work, had been made in 1973. These arrangements, 
in effect, chartered the Learning Centers as alternative 
hiqh schools. Between the accreditation of the DCs in 197 3 
and the NEP-2 start in 1974, 34 LC students had become high 
school graduates and 42 had passed the GED exam. 

Aviation High School, | 

Aviation is a comparatively small (total enrollment: of 
1900) California high school in the Soutsh Bay Union High 
School -District. During the 1973 fall semester. Aviation's 
Vice-Principal ^r Counseling began searching for alternative 
education for freshmen who, on the basis of their first 
semester's work, seemed destined to fail in Aviation and to 
find themselves, accordingly, in continuation school in 

13 
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1974-75. Becau^the continuation school had a poor repu- 
tatioji, the Vice-Principal was unwilling %o allow these 
failing freshmen to slide through their j^econd semester 
into continuation school. . ' 

j To arrest the process, the .V,icet-Principal organized a ' . 
"pilot project" for the freshmen: she gave them a large 
clasproom, a teacher and a teachejf's aide with the hope that' 
thesb special measures would reyerse their academic failure. 
W^thj the establishment of "bhis ' special education project 
other -prpblem students were gis signed to it: a group of 6 
soiDhomores who Had 'severe reading problems, and a group- of 19 
fre\Shmen who were also lo^-achievers in reading. Each of 
the' reading groups met vith the teacher for one class period 
(55 minutes) ; whereas, the "pilot" freshmen — a group of 25 
failing students — speiit their entire three-period class 
day with the teacher- 



At this poiiit, GA and -the NEP-2 were called in. ^The ' 
installation of the NEP-2 in Aviation involved a re-organ- 
ization of the classroom, assembling NEP materials and train- 
ing of the Reaching staff in the NEP. system, and working out 
academic credit arrangements for NEP-2 work. 

The classroom was NEPized by substituting tables and 
chairs ,for standard school desks, by placing materials along 
the walls, and by the creation of a 10-f Oot-square carpeted 
space for a rest and/or game area. It was decided that all 
the students would use this classroom: the sophomore read- 
ers in period 1, the pilot freshmen in periods 2, 3, and 4, 
And the freshmen readers in period 6. 

r 

'In Aviation, "the establishment of academic credit 
equivalents for NEP* achifevfements involved equivalencies for 
work in stand|S|:d classes. For the one-period readers, 
successful NEP achievement would merit 5 high school credits. 
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For the pilot students, the situation was more complicated 
since the goal with these students was not only to achieve 
a successful semester but to re<:oup failure in the preceding 
semester. It was decided that NEP work equivalent to 10 
high school credits would be sufficient to arrest the slide 
to continuation school, and that NEP work equivalent to 20 
credits would add up to a c<OTipletely successful freshman^ 
year. 




NEP-2 students 

1 

When the study period ended in September, 1974 „ a 
total of 528 persons had been NEP studej^ts. By far the 
largest site^ so far ^s nuiriber of subjects was concerned, 
was Byron/PPC, which accounted for 60 percent of all study 
subjects, for 58 percent of all m&le subjects, for 56 per- 
cent of all male white subjects, and for 58 percent of all ' 
male black subjects. ^ 

/ 

As would be expected from our sit3e descriptions, the 
characteristics of study subjects varied greatly between 
sites ('see Table 1) . Pacoima students were much older and 
had completed more schooling, on the average, than students 
in the other sites; and, in terms of age and completed school 
school ing. Aviation students were at the other extreme. 

» None of the Aviation students, and only 9 percent of 
the Byron/PPC students, were dropouts from standard school. 
All of the NYC students, on the other hand, were dropouts, 
and sxabstantial proportions of them had been out of school 
for more than half a year when they enrolled in the NEP 
(68 jbercent in Long Beach, and 50 percent in Spokane) . The 
older, better-educated Pacoima students contrasted sharply 
with study groups in the other sites: more than half of 
them had completed high school (or passed the GED) , and 50 

* 1. Retesting continued for three months after this date 
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percent of them had been out of school at least a year and 
a half when started in the NEP. 



Table 1 Selected Characteristics of NEP-2 S^udy Groups 



r 


Byron 
& 
PPC 
•N=196 


Pacoima 


Long . 
Beach 
'lj=92 ' 


Spokane. 
N=95 


Aviation 
N=49 


Sex — 
Male 
Female 


100% 
0 


24% 
76 


49% 


48?^ 


59% 

A 1 


Race — 
White 
Black 
•Chicano 
Other 


65% 
23 
11 
1 


45% 
17 
35 
3 


35% 
45 
16 
4 


82% 
6 

8 ^ 
3 


84% 

2 
12 

2 


Intake vartabl ^^a—^. 
Age ^'mean years) 


16.3 


25.3 


.17. 9 


17.7 


15.1 


Schooling (mean 


Q 1 


• 

ii . 4 


9. 9 


9". 5 


8.1 


Mont h^ but of * 
scho^ 

6, or^S^ess 
. 7-17 

. 18, or more 


91% 
9 
0 


18% 

32 

50' 


3 3% 
40 
, 28 ■ 


50% 

35 

15 


100% 
0 
0 


-Work-relevant atti 
tude (mean score) 


6.2 - 


,10 , 0 


8.1 


8.9 


4.7 


Interest in NEP 
(mean rating) 


' 3.0 • 


14 . 2 


3.7 


3.0 


2.8 



a . 



b. 



Work-relevant attitude sirore, based on 12 attitudinal 
items in intake interview, • is direct reflection of atti- 
tudes consonant with good adjustment to the world of 
work: the higher the scdre^ the better the adjustment 
indicated by the attitudes. 

Rated on a 5-Roint s<5fale <running from 1 (indifferent) to 
5 (very interested) . 



Among the younger out-of-school students (those in Byron/ 
PPC/ and the. two NYC sites), the last schooling of about half 
had been in regular day time schools (see Tabl6 2)'. The 
next most frequently reported prior school was continuation 
school (33 percent in Byron, and 39 percent in Spokane, where 

1. The 12 items making the Work-relevant attitude score 
are reproduced in the Appendix. 



continuation school was a site of NYC education) . In Long ^ 
Beach, the other NYC site, relatively mpre students had 
attended evening classes ^fter dropping out of regular school 
or were participating' ill NYC education^ 



Table 2 Kind of School when Last in 


School, Younger 


Out -of- 


school Students, 


by Site 


• 




(Percents of 


all reported 


students) 






Byron 








& PPC 


Long Beach 


Spokane 




N=196 


N=92 


N=95 


Regular, daytime school 


55% 


,47% 


42% 


Continuation school 


33 


0 


39 


Evening classes 


0 


• 13" • 


1 


Site program 


7 


■ 29 


6^ 


Other 


5 


10 


12 


Total 


100% 


99% 


100% 



a. NYC GED program. 



At the time of enrollment, all students were disked to 
respond to 12 "Work -Re levant Attitude" questions: questions 
developed In connection with evaluation studies of work- 
training programs. These quest ions\ were e!>ccerpted from a 
26-item scale that was factor-analyised intb three groups of 
attitudes: optimism, self-conf idende, and socialization. 
Although originally developed as work-relevant attitudes, 
it was thought that the attitudes involved might also apply 
to schooling. It was of interest that. the lowest average 
total work-relevcint attitude score was paroducecl by Aviation 
students, and the highest, by Pacoima students.. The scores 
appeared to be generally related to age and 'schooling com- 
pleted. 

Average total Work-Relevant Attitude scores suggested 
attitudinal differences in the study svLgroups (see Table 3) . 
In Byron/PPC, for example, the average score was higher 
(6.8) among students whose experience was at Byron on2,y than 
among other students in this site (5.3) — students who "ran," 

or who were at PPC at some time during their NEP experience. 

i 
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Table 3 Attitudinal Differences 
(Mean Work -Relevant 


in Study Subgroups 
Attitude score) 






N 


Mean 


Byron/PPC 
Byron only 

*->j[ oc r f iiiueiiupueQ oyron 


< 

118 
78 


6.8 
5.3 


Pacoima 

Clerical math (compulsory) 
Other math (voluntary) 


73 • 
23 


9.9 
- 10.5 


Long Beach 

"Headstart" 

Learning Center 2 

Learning Center 3 
* 


24 
34 
34 


8. 1 
6.5 
9.5 


Aviation 

Pilot freshmen (reading & math) 
Sophomore (reading only) 
Freshmen (i?eading only) 


24 
19 
6 


3.9 
5.3 
6.0 



Almost as great a difference appeared in the average 
Work-Relevant Attitude scores of the Pacoima compulsory 
clerical math students (9.9) and the other Pacoima math 
students (10, 5) . 

• In Long Beach, three possible study subgroups were dis- 
cerned in the site description: transferees from NEP-1, 
and new enrollees in Learning Centers 2 and 3. The trans- 
ferees, operationally defined as students whose initial SAT 
tests were administered more than a month p,rior to their 
first monthly reports of NEf>-2 participation and tagged 
"headstart" in Table 3, averaged higher Work -Relevant Atti- 
tude scores than did new students (students initially 
tested at the time of the NEP-2 start) in LC-2. The 
Long Beach students with the highest avepage attitudinad 
score were new enrollees in LC-3. 
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Similarly ,^ in Aviation, average attitudinal scores in- 
dicated differences between l^e pilot freshmen,, on the <4ne 
hand, and the reading only oroups, on the other hand. 

The persons who administered, the intake forms in NE;p-2 — 
teachers, teacher's aides, and sometimes, at the time of NEP 
starts, one or the other of the Graham Associates — were 
asked to rate the new student's interest in NEP education on 
a 5-point: scale running from 1 (indifferent) tto 5 (very 
interested) . Aviation students averaged the lowest interest 
ratings, while Pacoima students / averaged the highest. 

1\ was of interest that Long Beach students averaged 
significantly higher interest ratings than did students in 
the other NYC site* Spokane. The average initial interest 
ratings'of Long Beach students in LC-2 (3,2), however, 
were very little higher than the Spokane avergige (3.0) . ^ 
The significantly higher average initial interest ratings 
of Long Beach students in LC-3 (4.1) suggested a differ- 
ent situation in this subgroup. Although interest ratings 
obviously could reflect the rater as well as the ratee, 
it was noteworthy that none of the four raters involved 
in LC-3 ratings averaged less than 4.0 in their ratings, 
while three of the five raters involved in LC-2 ratings 

r 

averaged 3.0 and none averaged as much as 4.0. 

Initial interest in a program may predict achieve- 
ment prospects in that, other things being equal, high 
initial^ interest connotes easier achievement than does low 
initial interest. Average ihitial interest ratings in Byron/ 



- 16 - ' 



PPC were substantially the same for all >^acial subgroh^s 
(see Table 4) ; and average initial interest_ra±i^gs-<Ln Pa- 
coima ^nd^im Aviation were substantially tKe same^ for sex/ 
race subgroups, in the two NYC sites, however, average inir- 
tial interest ratings indicated that black students were 
less interested in the NEP and might, therefore, be- less apt 
to chalk up achievements in the program. This was parti- ' 
Gularly evident in Long Beach. 



Table 4 Initial Interest in NEP by Site^^ Sex, and Race 

(Means^ all reported subjects^) 



Byrpn 

& PPC Pacoima Long B^ach Spokane 
N=196 N=96 N=92 N=95 



Aviation 
N=49 





Male subjects 








0 






White 


3.0 


4.3 


3.5 


2.8 


2.7 




Black 


3.0 


4. 3 


3.1 


2.5 






sf Spanish sur- 














'tiaraes 


3.1 


4.4 


4.0 




2.8 




.^otal 


3.0 


4.3 


-3.4 


2.7 


2.7 




F em a 1^ s ub j^'ct .& 














White 




4.3 / 


^ 4.5 


3.4 


2.8 




Black 




3.2 / 


3-3 








Spanish sur- 














names 




4.2 


4.7 


■ 2.3 


3.0 




Total 




4.1 


3.9 


2.8 


2.8 



a. Except in^ Pacoima, where only 76 percent of the sub- 
jects were reported, substantially all svibjects were reported. 
The means are not reported if there are less than five sub- 
jects in a cell. 



Summary 

The characteristics of NEP-2 students in the several 
sites of this study indicated that the program would be 
tested in a variety of settings. On the basis of physical 
environments, education needs and programs, and student 
characteristics, the study involved at least eleven distinct 
student subgroups: 
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1. Byron (minimum security d^ention) " 

. 2. Pre-Placement Center .(maximum security detention) 

3. Pacoima mandatory math , 

4. Pacoima voluntary math 

5. "Long Beach ''headstart" (transfers from NEP-l).^" 

6. Long Beach Learning Center 2 
?• Long Beach Learning Center 3 

8. Spokane NYC . ^ . 

9, Aviation pilot freshmen (reading and math) 

10. Aviation sophomore (reading only) 

11. Aviation freshmen (reading only). ^ 

In addition to these subgroups , primarily reflective of site 
programs and substantiated to some extent by intake informa- 
tion, there were indications that distinct- subgroups associ- 
ate^ yith the sex and race of students were also present in 
some sites ;^ 

^ .€ 

While the number bf students involved in some of these ^ 
learning situations might sometimes be too small to support 
final conclusions for the subgroup in question, the charac- 
teristics ?^of study subjects assured that composite results 
would rem>ct the operation of the NEP in a wide variety 
of learning environments. ^ 
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NEP EXf^ERIENCE AND ACHIEVEMENT 

In Septeiriber, 1974, when the data-collection period of 
this, study ^nded, the records of NEP students were reviewed 
for indications of the program's operations and achievements. 
The principal data source^s were monthly and final reports 
of th^ students* participation, and test/retest results in 
reading and in math. In addition, the results of student 
questionnaires weye useful in some sites. 

NEP -2 part ic ipat ion 

Apart from the specialized NEP-? students (the Pacoima 
math and the Aviation reading students) most-NEP-2 students 
were scheduled for at l^ast 15 hours per week (see Table 5) . 
Average attendance, the proportion of actual attended hours 
to scheduled hours in the students ' record, ranged 'from 63 
percent in Long Beach to virtually perfe<*t in the confines • 
of Byron/PPC. -Average NEP-2 hours, reflecting the variables 
of scheduled -rhours, attendance, and calendar time in the pro- 
gram, ''ranged from 37 hours in Pacoima to 181 fn Byron/PPC. 

Interest and proqreag 

^The first monthly participation reports^ indicated average 
interest in NEP work wellr above th^midpoint of a 5-point 
scal^ in each site* except Aviation (2.9 in Aviation as 
compared with 3.9 in' the other sites combined). Compared 
with the rating of interest in the prospect of NEPj-2 educa- 
tion reported on the intake form ,(see Table 1, p. 12) actual 
interest in NEP work in the first month tended to be higher: 
slightly higher in l&yron, Pacoima, and Aviation, and very 



-In- 
significantly higher^ in Spokane (4.0 in the first reported 
month as compared with 3.0 on intake>. 



Table 5 Selected Characteristics of NEP-2 Experience, 
by Site 

(Means and oercents all reported subjects) 



Byron 



Long 



£c PPC Pacoima Beach Spokane Aviation 





N=196 


N=^6 


N=92 


N=95 


N=49 


Schedu3.ed weekly ^ 
hours 












a5-22.5 


• 4.5 


15-20 


15 


5-15 


Percent atten- 












dance (mean) 




' 73% 


. 63% 


68%- 


73% 


Months in NEP-2 












(mecin) 


3.9 


2.6 


4.9 


2.8 


3.6 


Attended NEP-2 












hours (mean) 


181 


37 


137 


124 


90 


Initial interest 








4.0 




(mean) 


3.9 


4.3 


3.5 


2.9 


Initial progress 












(mean) ^ 


3.1 


3.2 


;2\9 


3.1 


2.2 



a. Byrpn/PPC students were ordinarily scheduled for 
or 3 one-and-a-half-hour classes per day. 

Pacoima clerical math students were the only Pa- ' 
coima students with scheduled participation,. 

Long Beach LC-2 usually reported 15 hours per week; 
LC-3 usually reported 20 hours per week. 

Aviation readers were scheduled for 5 hours per 
week? pilot students were scheduled for 15 hours per week. 

b. First monthly report (MR) . Interest rated on 5- 
point scale: l=totally- uninterested; 5=always interested. 
Average rating when two or more teachers reported. 

c. First monthly report (MR) . Progress rated on a 
4-point scale: l=no progress; 4=good progress. Average 
rating when two or more teachers reported. 



1. Throughout this report, certain conventions Regard- 
ing "significance" will be observed. The adjective "signi- 
ficant" is reserved for descriptions of statistical signi- 
ficance and connotes differences that could be expected 
to occur by chapce no more than 5 times in 100. "Very 
significant" connotes differences that could be expected 
to occur by chance no more than 1 time in 100. 

Standard statistical procedures have been used to 
determine significance. 
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Average progress ratings on the first monthly reports 
clustered around the value of 3' (adequate progress) , except 
in Aviation where students averaged 2.2 (little progress). 

. In her repoi^t on , the first NEP month, the Aviation 
i \ .11 . ■ ■ 

teacher noted that getting NPP -2 materials was her "most 

successful classroon^ activ^l^V"" and that having the pro- 
gram materials solve^i most of Jier classroom problems. The 
difficulties surrounding the NEP-2 start in Aviation may have 
contributed to the lower interest and progress ratings of 
Aviation students in their first month. On the other hand. 
Aviation' s. relatively lower .first monthly report ratings 
were consistent wxth the impressions, produced^by intake 
variables, of relatively grater education problems * in this 
site. • 

' A number of NEP students were 'in the program for on^ly ' 
one monthly reporting period, either because they terminated 
early or because, they enrolled late. Short records were 
most prevalent in Spokalne where the records of 26 percent 
of the study subjects contained only one monthly report 
(MR) . In contrast, the records of almost all of the Avia- 
tion students contained at least two MR s (see Table 6). 

Comparisons of first and last participation ratings 
(see Table 7) indicated ^that, except in Aviation, both in- . 
terest and progress tended to diminish in the >::ourse of 
NEP experience. For the most part, the extent of rating 
change was not significant; but, in Spokane, the diminu- 
tion of interest (from an average 4.0 on tWli^first MR to an 
avetrage 3.5 on the last MR) was very significant. 
\ 



SO 



-7 



- 21 - 




Table 6 Per^centage of Students with more than one Monthly 
Report (MR) , by Site 



Byron Long 

& PPC Pacoima Beach Spokane Aviation 
■ N=196 N=96 N=92 N=95. N=49 

Student record — 

1 MR only 9% 17% 18% ' 26% 2% 

■"-v 2 or more MRs 91 83 82 74 98 




Table 7 Changes in MR Participation Ratings by Site 
(Means and percents of all multiple-MR records) 
Byron . Long 

& PPC Pacoima Beach Spokafie Aviation 
N=176 N=78 N=67 N=70 N=48 




Interest ratings^- 












First MR (mean) 


• 3.9 


4.4 


3.5 


4.0 


3.0 


Final MR (mean) ^ 


3.7 


4.3 


3.3 


3.5 


3.3 


Characterization 












of change — 












No change 


16% 


54% 


21% 


27% 


27% 


Increased only 


9 


10 


13 


3 


38 


Decreased only 


22 


22 


30 


34 


15 


Fluctuated 


53 


14 


36, 


36 


21 


Total 


100% 


100% 


100% 


100% 


101% 


Progress ratings^- 












' First MR (mean) 


.3.0 


3.3 


2.8 


3.2 


2.2 


Final MR (mean) 


3.0 


3.1 


2.6 


3.0 


2.6 


Characterization 












of change — 












No change 


18% 


51% 


31% 


36% 


27% 


Increased only 


12 


11 


13 


9 


. 33 


Decreased only 


20 


26 


24 


19 


13 


Fluctuated 


50 


12 


31 


37 


. 27 


Total 


100% 


100% 


99% 


101% ■ 


100% 


a. Interest is 


rated on 


a scale 


of l(low) 


to 5 


(high) . 


b. Progress is 


rated on 


a scale 


of 1 (low) 


to 4 


(high) . 



ERIC 
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Aviation results were in striking contrast to those from 
the other sites: final MR ratings in Aviation were very sig- 
nificantly higher than were initial Aviation ratings. These 
Aviation results were also reflected in the character of 
rating change. r 

Significantly more of the student records in Aviation 
showed improvement only; that is, at some time in their NEP 
experience, their ratings improved and at no time thereafter 
did their improved rating diminish. 

Although the character of change shown in Table 7 was, 
to some extent, constrained by first ratings (highest first 
ratings could only remain the same or decrease in subsequent 
MRs; lowest ratings could only remain the ^ same or* improve; 
and only records with three or more MRq could show both 'in- 
crease and decrease) , rating changes genera;Lly suggested that, 
•except in Aviation, the interest and'progress of from one- 
fifth, to one-third of the students deterioratjed in the course 
of their NEP participation. In addition, about half of the 
Byron/PPC students, and a little more than a third of the 
-iiong Beach and Spokane students fluctuated in their interest 
and progress. The combined proportions of decreased and 
fluctuating inteirest — about 70 percent in these three sites — 
indicated that progress in thfes^program might be difficult.^ 
While progress ratings tended to mirror interest ratings, 
changes in progress ratings in the NYC sites (Long Beach 
and Spokane) showed relatively fewer cases of decrease only. 

Job Corps units 

, The core curriculum of the NEP is composed of Job 
Corps materials in reading, math, and GED preparation. 
These materials, as well as other materials incorporated in 
the NEP, comprise modular achievement units. Ordinarily, 
the units serve as short-term goals for the student, and a 
growing total of Job Corps units — often graphed as a visible 
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symbol of achievement — has bei^n foxind to be a strong motiva- 
tor for NEP participation. . - 



The GED curriculum is directly related to the aca- 
'*demiQ goal of completing the secondary level of education.^ 
In the three unspecialized sites ^ most NEP-2 students were 
worl^ing with GED materials (see Table 8): in Byron/PPC 
66 percent; ih Long Beach^ 63 percent; and in Spokane, 75 
percent. The goal of completing their secondary education 
was nearer to those students than it was to most of the other 
students in these sites who were working only ii\ graded 
reading and/or math. 



Table 8 



Job Corps Ma^teriaXs and Job Corps Units Completed 
in N]?P-2 Experience, by Site 

(Percents .atid means of all subjects) 



Byron 




Long 






& PPC 


Pacoima 


Beach 


Spokane 


Aviation 


N=196 


N=96 


N=92 


N=95 


N=49 


Materials — 






I 




Reading only 1% 


1%^ 


0 


4% 


53% 


Math only 1- 


72 


2 


6 


0 


Reading & math only ' 33 


27 


. 34 


15 • 


35 


GED only 0 


0 


2 


12 


0 


Ged, reading and/or 










math 66 


0 


61 


63 


12 


Total 101% 


100% 


99% 


100% 


100% 

t 


Units completed (meeins) — 










Reading 3.0 


.1 


•6.^0 


1.1 


2.7 


M^th 2 . 3 


3.5 


5.3 


2.1 


> .6 


GED 13.1 


0.0 


27.2 


15.6 


1.6 


Total 18.4 


3.6 


38.5 


18.8 


4. 9 


Attended hours in 










NEP (means) 181 


37 


137 


124 


90 



a. Pacoima math students were the only Pacoima sub- 
jects who participated in the NEP testing program* The 
monthly reports of some Pacoima students, however, reflected 
work in reading also. 
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% Long jpeach students earned Job Corps credits* at a much 

liigher rate than did students in *the other site^. This 
higher Long Beach rate may have been partly due to the fact 
that Long Beach jteachers were more experienced in the use 
of NEP materials, more aware of the motivational advai)±ages 
of recording Job Corps ' achievements for their st^l^ts, 
and, consequently, better reporters of Job Cdrps t^nlf 
achievement for the study. , * * 

Job Corps unit achievements, determined by passing unit 
tests, were indicators of academic achievement. The relation-^ 
ships between Job Corps unit achievements and otlfer <lndica- 
tors of academic achievement, however, were not' d^6ct. 

High school credits 

Arrangements with local school authorities for the 
crediting of NEP .work towards a regular high school diplo- 
ma were reflected in reports of- earned high school credits. 
Reported high school credits were substantial in two sites: 
Byron/PPC students were reported to have earned 40 high 
school credits, on the average/ and Long Beach students, 39, 
on the average. 

In Long Beach, total average high schpol credits were 
substantially the same as total averap^ Job Corps units 
completed; whereas, in Byron/PPC, averd^6 high school cre- 
dits were much higher than average Job Corps units. The 
difference between these two averages in Byron/PPC reflect-' 
ed the fact that inmates could earn high school credits for 
, good behavior in other activities as well as for academic 
performance. 

compared to Byron/PPC and Long Beach results, the 
average of 7 high school credits earned by Aviation students 
was very small. In terms of their credit goals, however. 
Aviation students who stayed in the NEJp to the end of the 
school year achieved substantial success. 
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All of 'the Aviation reading students who stayed in the 
NEP to the end of the school yea'r earned, 5 credits, or the 
equivalent of successful, work in a regular English clasps for 
this period. The 18 pilot students who stayed with the pro- 
gram td June, averaged 12 high school credits, or 2 more thsm 
they neeced to have their NEP semester counted as a successful 
school semester. Two pilot students, who earned 20 and 25 cre- 
dits respectively, also recouped their failed first semester? 
and eight, pilot students, who earned from 12.5 to 15 credits, 
partially offset their first semester failures^ 

Very few high school credits (2 on the average) were i:e- 
ported for Spokane students. Spokane required only 32 credits 
for a diploma (instead of the 160 needed in Long Beach) ; but, 
in view of the substcintial numbers of Spokane students who 
completed secondary-level education (see Table 16, page 36) , 
it seems likely that Spokane credits were incompletely reported 

Test/ret est results 

When study sxabjects enrolled in NEP-2 projects they were 
screen-tested with short tests developed by the Job Corps: 
RJSl for reading, and MJSl for math. Subjects were then 
tested with an appropriate level of a Stanford^ Achievement 
Test (SAT) . At approximately three-month intervals thereafter, 
for as long as the subject remained in the NEP-2 project, 
subjected were retested. The differences between initial SAT 
scores and retest SAT scores provided an "objective measure 
of academic achievement. 

Fifty-six percent of all subjects were retested at least 
once (see Table 9) ,> with the proportion of subjects having 
retests being highest in Aviation (80 percent) and in Byron 
and Long Beach (67 percent in each of these sites) . Retest 
data were lacking for a majority of the Pacoima subjects 
(84 percent) and for about half of the Spokane subjects. Lack 
of retest data indicated that the subject was in the prdject 
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too* short a time (less than 3.2 months, on the average) 
to be retested. 



Table 9 Number of Reteats and Time between Retests^ by Site 



Byron 




Long 










PacoiiAa 


Beach Spokeme 


Aviation 


All 


N=196 


N=f96 


N=92 


N=95 




JM — D ^ O 


Number of retests — 












Three 0% 


0% 


11% 


0% 


0% 


2% 


Two 18 


0 ' 


25 


6 


0 


13 


One only 49 


16 


30 


42 






None 3 3 


' 84 


33 


52 


20 y 


44 


Total 100% 


100% 


99% 


100% 


100% J 


100% 


Time between retests^ 


^ (mean months) — 








SATR1-SATR2 3.2 




3.5 


2.7 


3.1 


3.2 


SATM1-SATM2 3.2 


3.2 


3.5 


2.7 • 


3.0 


. 3.2 


SATR2-SATR3 3.1 




3.3 


3.0 




3.2 


SATM2-SATM3 3.1 




3.3 


3.0 




3.2 


• a. To save space, tests 


are designated 


as follows: 








Reading 


' Math 




Initial test 


SATRl 


r 


SATMl 




First 


retest 


SATR2 




SATM2 




Second 


retest 


SATR3 




SATM3 




Third 


retest 


SATR4 




SATM4 





First retest results indicated that the average grade 
level achievement of all NEP-2 subjects had increased very 
significantly after about three months of NEP-2 experience 
(see Table 10) . The average grade level improvement in 
rea4ixig was .8 and the average grade level improvement in 
math was .7. In three sites (Byron/PPC, Long Beach, and 
Spokane) the average grade level improvement was about the 
same in reading and in math. These improvements were statis- 
tically very significant {Bi both subject areas. In Aviation, 
reading retests, which reflected the freshman and sopho- 
more reading classes as well as the pilot subjects, indi- 
cated a very significant average gain of an entire grade 
level. The math gains of Aviation students, which reflected 
only the pilot group, were less dramatic (.4 of a grade. 
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on the average) but shcjwed significant improvement. 



Table 10 Changes in SAT scores (mean grade levels) between 
Initial Test (SATl) and First Retest (SAT2) , by 
Site 





Byron 
& PPC 


Pacoima 


Long 
Beach 


■ 

Spokane 


Aviation 


All 
















^ Nxjinber 


132 


0 


62 


46 


39 


379 


SATRl mean 


6.2 




6.7 


8.1 ' 


5.4 


6.5 


SATR2 mean 


6.9 




7.4 


9.2 


6.4 ^ 


7.3 


Increase 


.7 




.7 


1.1 


1.0 / 


.8 




* * * 




* * * 


*** 


*** 


*** 


Math 














Number 


131 


16 


62 


45 


19 


273 


^ATMl mean 


5.5 


8.1 


5.7 


6.7 


5.5 


5.9 


SATM2 mean 


6.2 


9.1 


6.4 


7.7 


5.9 


6.6 


Increase 


.7 


1.0 


.7 


1.0 . 


.4 , 


.7 




*** 


** 


lAr lAr lAr ^ 




* 


*** 



a. CL=Conf idence Level, or the statistical significance 
of differences between the scores, indicated as follows: 



* significant at the .05 level (could have occurred 
by chance no more than 5 times in 100) 

** significant at the .01 level 

*** significant at the .00.1 level 



Second retest results, entirely lacking in Pacoima 
and in Aviation, and substantially j^acking in Spokane, 
indicated little or no progress in average grade level 
since the preceding retest in Byron/PPC. In Long Beach, 
however, second retests ingiicated continued progress at about 
the same rate in both reading and math. In the half year 
covered by first and se^nd retests, Byron/PPC subjects 
involved in these results had^ significantly improved their 
achievement by about half a grade level (see Table 11) . 
The maintaihed progress of Long Beach and Spokane subjects 
in the period between second and third retests improved their 
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reading and math grade levels by about 1.5 grades in the 
half-year period. 

Table 11 Average grade level Increases between Retests 





Byron 
& PPC 


Pacoima 


Long 
Beach 


Spokane 


Aviation 


Onte retest 












^ only (N) 


(96) 


(16) 


(28) 


(40) 


(39) 


Increase — 












SATR1-SATR2 


.8 




.8 


1.1 


1.0^ 


SATM1-SATM2 


.7 


i.o' 


.8 


1.0 


.4^ 


Two retests (N) 


(36) 


(0) 


(34) 


(6) 


(0) 


Increase — 










SATR1-SATR3 - 


.5 




1.3 


1.5 




SATM1-SATM3 


.6 




1.4 


1.6 

4 





a. Average reading increases in the 3 Aviation sub-' 
groups were: 1.3 (pilots, N=20) ; .5 (freshmen reading only^v 
N=14) ; and .8 (sophomore reading only, N=^5) . 

b. Pilot students only. 

For students in the program long enough to be retested 
twice, the rate of gain registered ih/the first retest was 
maintained in the succeeding period in both Spokane and Long 
Beach. Byron students who remained in detention and in, the 
NEP, however, averaged lower scores on the second retest than 
they did on the first. The failure of Byron/PPC students to 
maintain academic achievement gains in the second retest 
period proba^jly stemmed from the fact that the longer the youth 
stays in a detention facility the more likely he was to have a 
poor attitude toward education since achievement in the edu- 
cation classes is one factor leading to early release. There 
was also more evidence that the youth who stayed in Byron long 
enough to be tested twice did not make as much effort on the 
second retest as he had on the first. The second retest in 
Byron should, therefore be disregarded in evaluating the 
effectiveness of the NEP program. 



The length of the study period generally precluded 



more 
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than two retests among students who started in the N)SP at 
the time the site project was activated. In Long Beach, 
however, third retest results were available for eleven stu- 
dents (see Table 12) . The more ext^aive Long Beach retest 
results were due to the facts that (1) early retest results 
were available for headstart students and (2) late test re- 
sults, forwarded after the data-collection period ended, 
were ^ailable in Long Beach. Although the participation 
record§\of these Long Beach students were incomplete, their 
final retest results indicated that they had improved by 
about two grade .levels in their reading and tnath in 10-11 
months. Students who stayed in the Long Beach program, in 
other words, maintained an average increase of a littje 
more than half a grade for three retest oeriods. 

Table 12 Changes in SAT Scores between Initial Test (SATl) 
and Retests (SAT2, SAT3, and SAT4) , ^ong Beach, 
by Subgroup 



SATl and SAT2 (number) 

Mean grade level increase 
Reading 
Math 

SAT2 and SAT3 (number) 

Mean grade level increase 
Reading 
Math 

SATl and SAT3 (number) 

Mean grade level increase 
Reading 
Math 

SATl and SAT4 (number) 

Mean grade level increase 
Reading - 
Math 



tart 


Learning 
Center 2 


Learning 
Center 3 


All 


(21) 


(17) 


(25) 


(62) 


.5 
.8 


1.0 
.4 


.8 
. 7 


.7 
.7 


(14) 


•(4) 


(16) . 


(34) 


.8 
. 5 


.9 
1.5 


.4 

.7 


.6 
.7 


(14) 


(4) 


- (16) 


(34) 


1.4 
1.4 


2.^ 
2.1 


1.0 ^ 
1.3 


1.3 
1.4 


(8) 




(3) <v 


(11) 


2.2 ' 
2.1 




i.o 

2.3 


1.9 
2.2 



o 
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NEP-2 compared with NEP-1 

Two sites in this study. Long Beach, California and 
Spokane, Washington — were Neighborhood Youth Corps (NYC) 
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projects; and results from these sites provided the oppor- 
tunity of comparing NEP-2 with its predecessor program, 
NEP-1. Compared with NEP-1 NYC study groups, the composite 
NYC NEP-2 study group contained more women, ^ more whites, and 
fewer Spanish surname subjects (se^ Table 13) . The two com- 
posite NYC groups were similar in age and schooling. The NEP-2 
group was reflected in relatively more single retests, and 
about one-fifth of the subjects in both composite NYC groups 
were retested two or more times. 

Table 13 Selected Characteristics of Neighborhood Youth 
Corpa Study Groups in NEP-1 and NEP-2, Selected 
Variables 



(Percen ts or means of all reported subjects) 

NEP-1^ NEP-2^ 
N=207 N=187 



Sex— ■- 






Male 
Female 


66% 
34 


49% 
51 


Race — 
White 
Black 

Spanish surname 
Other<3 


17% 
30 
41 
12 


59% 
25<, 
13 
3 


Intake^ variables — 






Age (mean years) 

Schooling completed (mean grades) 


17.4 
9.8 


17.8 
9.7 


Number of retests — 






Two, or more 
One only 
None 


2 3% 

22 

55 


21% 

37 

42 



a. Includes Orange County, San Francisco, and Santa 
Barbara. 



b» Includes Long Beach and Spokane. 

c. Includes Chicano, Mexican-American, and Latin- 
American. 

X 

d. Includes American Indian, Asian, and Filipino. 

Retest results were similar, with NEP-2 showing a little 
more strength in reading gains. In both NEP-1 and in NEP-2, 
comparisons of second retests (SAT3) with initial SAT scores 
indic^ated that ^tudy subjects who stayed in NEP ajppro^lmately 
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six. months improved/ their readintf grade levels by at least 
one grade on the average, and, their math grade levels by 
1.5 grades, on the average (see Table 14) . 

Table 14 Changes in SAT scores between Initial Test (SATl) , 
First Retest (SAT2) and Second Retest (SAT3) in 
Neighborhood Youth Corps Sites, NEP-1 and NEP-2 



NEP-1 ' NEP-2 



SATl compared with SAT2 
Reading 

Number 94 108 

Increase (mean grade level) .6 ,9 

Math * r . - 

^ Number 91 107 

Increase (mean grade level) 1,1 .9 

SATl compared with SAT 3 
Reading 

Number 47 ^ - . ' 40 

^ Increase (mean grade level)/ 1.0 ' 1.3 

Math ' 
Number ^5 40 

Increase (mean grade level) 1,5 ' ' l-;4 



Schoolincr outcomes ^ 

^ Except in Pacoima, where NEP students were primarily 
interested^ in the improvement of job-related academic skills, 
schooling outcomes were important indications of NEP achieve- 
ment. Depending upon the students' plaices in standard 
schooling systems — ^whether students were still "in School," 
or whether they had dropped out *of school — meaningful NEP 
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achievements consisted of either (1) earned high school cre- 
dits that would enable students to maintain-or improve t^heir 
positions in the^schooring mainstre'am, or (2) the completion 
of secondary level schooling through the accumulation of 
enough credits to e^n a high school diplotoa or through 
successful preparation for the GED. 

Aviation - 

The Aviation NEP was exclusively targeted on enabling 
students to maintain or to improve their positions in the 
schooling mainstream. Most Of^the Aviation students—all 
of the readers and fourteen of the eighteen pilot students 
who stayed in NEP to the end of the school year — earned 
high school credits sufficient to keep them in the schooling 
mainstream. Substantially complete retest results for Avia- 
tion sttidents indicated that their high school credits were 
backed up with significant gains in academic skills. 
I .. ^ ■ 

Three of the pilot students, however, failed to achieve 
the program's goal of avpidin^Tcontinuation school in their 
sophomore year: they were ejected from the NEP and wound 
up in continuation school in the second semester of their 
freshman year. This outcome was reflected in the teacher *s 
April report, which noted that in the week following spring 
vacation, when her aide was absent, the pilot class got out 
of control. At this point the teacher removed the carpet 
and cushions from the games/recreational area of the class- 
room. Although this change towards a more conventional 
schoolroom "helped, the teacher's May report noted that 
some pilot students were still problems. This time, the 
teacher organized a group discussion, the result of which 
was to send the "rowdies" to the office. The troublemakers 
were not encouraged to return. ^ 

The incidents in Aviation's pilot group following spring 
vacation appeared to illitetrate that these "problem" stu- 
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dents had. achieved an esprit de corps by their third NEP 
month. If so, this majority iji|:erest in achievement repre- 
sented a noteworthy attitudinal improvement. 

Byron/PPC . 

Although NEP students in the two detention sites, ' 
Byron and Pre-Placement Center, were outside the school-* 
ing mainstream, the goal of education in these sites was to 
enable students to keep up with tlteir classmates on the 
"outside" so that schooling could be successfully res\amed 
when they returned to their homes, 

FroA retest results it is evidei^ that Byron/PPC stu- 
dents who were in the NEP long enough to be retested averaged 
significant gains in reading and math, particularly in their 
first three NEP months, , These 'results agreed well for the 
maintenaijce of good steinding in "outside" school systems. 

Byron/PPC subjects who .were not retested appeared to 
be of two 'kinds: (1) relatively well-adjusted young men, 
near the end of their detention periods; andji in some cases, 
relatively near, also, to having enough high school credits 
for a diploma; and (2) relatively ill-adjusted yo\yig men 
who -'ran" before they had been in the NEP long enough to be 
retested. Retested Byron/PPC students differed significant- ' 
ly from those without retests (see Table 15) in the larger 
proportion of students "graduated" from detention 42,8 
percent as compared to 13 percent) and in the smaller pro- 
portion of students who "ran" (8 perce^it as compared to 
20 percent) . 

On the other hand, more of the unretested students 
achieved high school diplomas, and the proportion of Byron/ 
PPC students who left detention ^nd the NEP to return to 
regular school was about the same^ whether orv not the student 
had be^n in the NEP long enough to be retested. 



Table 15 Schooling Outcomes in Byron/PPC by Retest 
(P ercents and means of all sttidents) 





N=132 


N=64 


N=196 


nxgii sciioox Qxpxoma 


3% 


11% 


6% 


Returned. to school 
"Graduated" from detention 


31 
28 


30 

13 


31 


"Ran" frdm detention s 


8^ . 


20 


12 


Still in detention at end of 
stuay penoa 


i 

29 


27 


28 


* Total 


99% 


101% 


100% 


High school credits (mean) 


48 


22 


40 


Hours in NEP (mean) 




87 * 


181 


Average, credits per 100 hours 


21 


V 

25 


22 


a. Includes one retested 
the NEP. 


svibject who 


was ejected from 



Bec^^tse both retested and unreteste'd Byron/PPC students 
earned ^igh school credits at about the same rate, it cduld 
be concitided that the NEP enabled all students in this site 
to keep up with their schooling. The higher proportion of 
runaways in the unr^ested group, however, suggested that 
more of these students would not return to regular school. 
If so, the failure to return could not reasonably be ascribed 
to NEP . 

iMd^kb^Jch and Spokane 

Iiii, the two NYC sites, the NEP substituted for main- 
stream ^schoolings most- of the ^ out -of -school young people 
in these sites would complete their secondary education in 

^^^^^ °^ retest results were mor^ 

ext6ingive in Long Beach than in Spokane, these results in\ 
both 'site^ ilidicated that' students who stayed in the NEP 
long enoug^ fcO be retested made significant improvements 
in their reading and math skills. 
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^ About the same proportion" c3|t- retested students in both 
sites (19 percent in Long 'Beachf^^ and 24 percent in Spokane) 
completed their secondary schooling in the NEP (sefe Table 
16) . The proportion of unretested students in these sites^ 
who achieved 'a diploma or passed the GED was even larger: 
a result suggesting that many NEP students came aboard 
when they were close to completing their secondary school 
educations. Although the NEP could not take substantial 
credit for this achievement of short-term NEP students, 
these results suggested that the shortness of some NEP 
experience could be associated with academic achievement for 
the student. Somewhat the same situation was also suggested 
in higher proportions of Long Beach unretested students who 
left the program for a job (20 percent; as compared to 3 
percent of the retested Long Beach students). These results 
suggested that lack of academic achievement among unretested 
Long Beach students may have been offset, to some extent, by 
vocational achievements. Again, these possible vocational 
achievements of shqrt-term students could not, by and large, 
have been influenq^ii by NEP. 

In both NYC sites, i-'Siatively more of th'e unretested ^ 
students were described as terminating bec^se they had 
quit the NYC, had been ejected by the NEP,^r had lost 
interest in the NEP. Although some situations reflected in 
the NYC-quits were .not inconsistent with subsequent school 
achievement (e.g., quits due to pregnancy or moving), it 
might be assume^ that some NYC-quits (e.g., quits, due to 
jailing or loss of interest in the HtYC) connoted poor pros- 
pects for subsequent achievement as did terminations due to 
ejection from the NEP. and to loss of interest in the NEP. 

These terminations tended to weed out students who 
were not benefiting from NEP and to result in a residual 
student body with better prospects of NEP achievement. At 
the end of the data collection period, the Long Beach stu- 
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dent body of 40 was composed of- 33 students (83 percent) 
with retest experience and of 7 new studehts who had njbt been 
in long enough for a- retest. The Spokane endi-of-stud/ stu- 
dent body ^numbered 32, with 25 (78. percent) retested students 
and 7 new studehts. Because the new students in these two 
sites were entering situations where the toi^,set by the 
majority of the students could, be expected to be one of 
achievement, the achieveme,nt prospects of the new students 
were good. 



Table 16 Schooling Outcomes in Long Beach and Spokane, 
by Retest 

(Perce nts of all subjects) 
Long Beach 



Retested 
N=62 


Not 
Retested 
N=30 


Retested 
N=45 


Not 
Retested 
N=50 


Completed high school 
or passed GED . 


19% 


2 3% 


24% 


54% 


Left NYC/NEP fqr job 


3 


20 


9 


8 


Terminated from NYC^ 


8 


27 


9 


16 


Ejected from NEP 


5 


3 


2 


4 


Lost interest in NEP 

Still^ in program at the 
end 6f the study period 


0 


3 


0 


4 


65 


23 


56 


14 


Total 


100% 


99% 


100% 


100% 



a. Terminated because pregijant, moved, or jailed. 
Pacoima 

In contrast to the students in other sites, Pacoima 
students were almost exclusively interested in the NEP as 
a means of improving job-related academic skills. Many of 
the Pacoima students had already completed their aeconddry 
school education, and even those who lacked a diploma or a 
GED were in the NEP to polish skills in order to qualify 
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for jobs. Only a small proportion of the Pacoima students 
(16 out of 96) were reflected in test/retest results which 
indicated that math students (the only Pacoima students in 
the study) improved by one »'grade level, on the average, in 
about three months. 

Compared to Pacoima students who did not stay in the 
NEP long enough to be retested (see Table 17) , retested 
Pacoima students were significantly more apt to have left 
the skill center for a job. Although the number of retested 
Pacoima students was small, Pacoima results indicated that 
the NEP had been effective in improving math skills smd 
suggested t^iat improved math skills were associated with 
enhanced employability . 



fable 17 


Schooling Outcomes 
(Percents of 


in Pacoima by Retest 
all students) 








Retested Not 
N=16 


Retested 
N=80 


Left skill 


center for^job 


88% . 


55% 


Terminated 


from skill center 


13 


28 


Terminated 


from NEP only 


0 


18 


.Total 




101% 


101% 



Most of tjjie pacoima . retests (13 out of 16) occurred in 

^ J* • 

the compulsory, clerical math group. 



Ratings of usefulness 

Students' termination report;s included a rating by a 
member of the NEP .staff as to the overall usefulness of NEP 
experience. This 3~point rating (l^a waste of time; 2=some~ 
what useful; 3=very useful for the student) served to 



1. The rating on the form was in reverse order; i.e., 
l=very useful. ^ 
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suiranarize the views of the program on its usefulness to each 
student. Comparisons of average usefulness ratings between 
retested and unretested students (see Table 18) tended to 
supi^ort the expectation that retested students benefited 
more from NEP than did^ the short-term unretested students. 
The differences between the two grmips, however, were often 
slight. This lack of contrast suggested that (I) raters may 
have been unimpressed with the usefulness of NEP experience, 
notwithstanding fairly solid academic achievements and/or 
(2) raters may have tended to report a "safe" middle rating 
of "2." ' 

Table 18 Usefulness of NEP Experience, Retested and Un- 
retested Students by Sitfe and Subgroup 



(Means, all reported 


subiec 


ts) 








Retested 


Unretested 


All 




N 


Mean 


N 


Mean 


N 


Mean 


All Byron 


126 


2.4 


• 62 


2.1 


188 


2.3 


Uninterrupted Byron 


78 


2.5 


35 


2.2 


113 


" 2.4 


Byron and ppc 


48 


2.3 


27 


2.0 


75 


2.2 


All Pacoima 


16 


3.0 


78 


2.7 


94 


2.8 


Clerical math 


13 


3.0 


59 


2.9 


72 


2.9 


Non-clerical math 


3 


3.0 


19 


2.3 


22 


2.4 


All Long Beach 


53 


2.6 


27 


2.3 


80 


2.5 


All headstart 


19 


2.6 


3 


2.7 


22 


2.6 


All LC-2 


14 


2.5 


16 


2.4 


30 


2.5 


All LC-3 


20 


2.B 


8 


2.0 


28 


2.5 


All Spokane 


/*4 


2.4 


50 


2.5 


94 


2.5 


All Aviation 


37 


2.2 


11 


2.0 


48 


2.1 


Pilots 


18 


2.3 


5 


1.6 


23 


2.1 


Sophomore (reading only) 


14 


2.0 


5 


2.2 


19 


2.1 


Freshman (reading only) 


5 


2.2 


1 


2.0 


6 


2.2 



This lack of contrast was particularly evident among the 
Pacoima clerical math students. Long Beach headstart and LC-2 
students, Spokane students, and Aviation reading only. The use 
fulness of the NEP in such situations apparently was not 
closely related to program tenure. Well-qualified students, 
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stich as GED-reaidy NYC students, undoubtedly benefited from 
the finishing touches provided by short-term NEP experi- 
ences as did students who had farther to go, academical3-y# 
and needed more NEP time to do so. From the point of view 
ofv substantial NEP contrib\ftions l^o the students' educa- 
tion, however, the high NEP usefulness ratings for unre- 
tested students mean less than the high usefulness ratings 
of students who were in NEP long enough to be retested. 

Student questionnaires 

Data-collection forms included a one-page student 
questionnaire, primarily designed to provide feedbacl« on 
program operations. These forms were not used with regular- 
ity or consistency, but they are of interest because they 
provide a direct reflection of the vieyzs of NEP Students. 

To insure free feedback, instructions for the adminis- 
tration of the questionnaires provi^Jed for anonymity at the 
option of the student. In all, 225 questionnaires were 
received, and 43 (19 percent) of them were anonymous. 
Virtually all of the unsigned questionnaires were from 
Byron/PPC (58 percent) and Spokane (40 percent) . Compari- 
sons of signed and unsigned questionnaires in these two sites 
indicated no significant differences and "suggested that the 
greater incidence of anonymous questionnaires in Byron/PPC 
and Spokane may have reflected administration procedures 
in these two sites. 

In Pacoima, Aviation, and Spolji^ane, student question- 
naires were completed near the end of the study period: 
March/April in Pacoima, June in Aviation, and August in 
Spokane. These end-of-study questionnaires, reflecting act- 
ive students in the progrsun, clearly could provide little 
useful feedback to the NEP staff. On the other hand, they 
provided a fairly complete reflection of student bodies in 
these sites. 

4D 
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The administration of student: que^stiohnaires in Byron/ 
PPC and in>Long Beach, on the other hAnd, occurred at in- 
tervals in the course of the study anji provided samplings 
of student views at a number Of' different poinlla .in time; 
and, particularly in Long Beach, some students completed more 
than one questionnaire. The timing of questionnaires in 
these two sites suggested that the form could have -served 
its feedback purpose in Byron/PPC and in Long Beach. 

All told, the study produced 182 signed' questionnaires^ 
(see Table 19) , with from 19 percent (Byron/PPC) .to 63 per- 
cent (Aviation) of all students returning signed question- , 
naires. Except in Long Beach, most students with question- 
naires completed only one form. 

Table -19 signed Student Questionnaires, by Site 



Byron 
& PPC 
N=196 

\ !''' ri 'I 


Pacoima 
N=96 


Long 

Beach 

N=^2 


Spokane 
N=95 


Aviation 
N=49 


Nuj!?^^^i5r forms ^' 
One' ■ 38 
iVo 1 


N. 

22 
1 


N. 

44 

13 


N. 

27 
4 


N. 

31 
3 


Percent of all stu- 
dents with at least 
one questionnaire 19% 


23% 


48% 


28% 


63% 



The questionnaires aaked the student to rate NEP on 
•a number of points— the interest of NEP materials; the help 
fulness of NEP teachers, and the like-to suggest improvement^^^ 
and to comment on the program generally. When questionnaires 
were doded, the student's responses were characterized in 
a 3-point rating: 3 (favorable); 2 (mixed); and 1 (un- 
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;,nonJ;;„ °^^^"!f °^ possibility of multiple responses, 

anonymous quest ionrvaires had to be excluded from consideration. 



favorable) . 



In their responses on ttxe quest i.onnai res, NEP students 
strongly endorsed the NEP (see Table 20) . On a 5-point 
scale comparing the amount learned in NEP with the aunount 
learned in otiher education, the students averaged 4.2; on 
a 4-point scale rating the interest of NEP materials, the 
students averaged 3.1; and on a 4-point scale rating the 
teachers helpfulness, the students averaged 3.7. The coder's 
evaluations of all responses , including comments, rated on 
a 3-point scale> averaged 2.5. 

Table 2^: Selected Variables, Student Questionnaire, by 
^ Site ^ 

. By^u\: Long 

Si P^C AP^cbima Beach Spokane Aviation All 
. N=38> A N==22 N'=44 N=27 N=31 N=162 

/'.'V [ ' - \ ' ^ — 

X'oul feel yok^Mixl^^i' : ' 

^ learning. ,^more 3.9 * ' 4.8 4.3 4.3 4.2 4.3 

Materials are^. . . 
in4:erest;^ing ' 3.0 • 3. 5 3.2 2.9 3.0 3.1 

Teacher is^ 

helpful \^ 3.3 3v8 3.9 3.8 3. 5 3.7 

Overall rating^ 2.2 2.9 2.7 2.5 2.4 2.5. 

a. 5-point scale. Compared to the last school you attend 
ed, you feel now like you are learning: (l=much less; 5= 

much more) . 

b. 4-point scale. The materials you are using now' are: 
(ls=very boring; 4=very interesting) . / 

c. 4-point scale. VHien you are trying to ^understand and 
leanl, you find that the teacher is: (l=not at all helpful? 
4=very h^pful) . 

d. 3-point scale. Coder's oveirall rating of responses: 
(l^unfavorable? 3=£avorable) . 
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Pacoima students t^urned in the best report of the NEP 
and students in the two NYC sites (Long Beach and Spokane) 
turned in similar and next-best ratings. Aviation and Byron/ 
PPC students trended to view the program with least approval; 
tut, even in these sites, students gave the program high 
ratings., , ^ 
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Comments froift student questionnaires ■ ; 'i . 

Student questionnaires concluded with two open-ended 
questione. How do you think this program could be improved? 
and What other positive. and negative reactions do you have? 
Half of the first set of questionnaires from students con- 
tained written comments describing possible improvements 
(see Table 21), and 32 percent described positive or nega- 
tive reactions, with most of these reactjlons being positive. 
Although only a small^ fraction of all NEP-2 students was 
reflected in specific student coramehtsv the continents are' of 
interest because they show the program from the student's 
viewpoint. Student comments did not lend themselves to 
statistical evaluation, but they provided insight into, how 
the program worked in the several sites. ^ ; / 

Pacoima, Spokahe, arid Aviation 

In three sites, questionnaires reflected end-of-study 
student bodies and constituted a kind of "final word" on 
NEP-2. V 

The comment of one Pacoima studerjlt, "I didn't think 
I could learn Any more after I had graduated from high school, 
but I have," summarized the value of NEP-2 for students 
primarily interested in academic skill improvement rather 
than in the completion of secondary-level education. The 
comments of Pacoima students that were picked up as nega- 
tive qualifiers per^taiined to the wfeole Pacoima education 
system: one student wrote, for example, that she would have 
like^ more extra-curricular school activities, and another. 
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that she 'would have liked' a course in Accounting. 

Tabl^e 21 Comments .from NEP-2 Students, First Student 
Quest ionnairesr 

(Percents of all subjects signing questionnaire) 



How do you think this program could ^ N=162 

be improved? » 

No comment " ' ^ 39% 
Comment, ho improvement desc^ribed ^22 
Connnent^ improvement idescribed — 

Materials and curriculum changes . 17 

More teachers (more individual help) ^ -M * ^ 

Other (classroom setting, discipline) W * - 14 

Ttotal 10196 

Other pos:|.S:ive cind negative reactions — 

- No written reactions 68% 
Reactiohs-|-^ 

Positive^ 26 

Negative ^ ^ ^ 6 

, Total o: * 100% 

4 



Cjualifyi^g comments in Spokane tended to point up the 
idea that scftne^lyoungsters in educationally-efficient pro- 
grammed instruction missed such attributes of standard 
Schooling as jphysical education, a football team, or, as 
one student wrot,e, the program should "be more like a regu- 
lar school*," • Such comments were more than balanced by Spo- 
kane students who commented to the effect that they didn't 
thifik the program needed any improvements, oV, far from 
wanting extra-curricular activities, desired more emphasis 
on academic performance. One Spokane student expressed this 
attitude: "The only thing it (the program) needs is a little 
more strickness for working on school work." The comment 
of another Spokane student implied a commitment to academic 
performance: "From my experience the improvement (of the 
program) would have to come from students rather than from 
the adbministration." 
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At the end of the school year, most of the Aviation stu- 

a 

dents completed questionnaires reflecting four months of 
NEP-2 experience, and most of them praised the program and 
its teacher. • It was of interest that several students 
commented, explicitly or implicitly, on the valu6 of the class 
as, a resource for students in academic difficulties. They 
wrote that the program could be improved: 

"If we could have it here next year." 

"By putting more classes like this into the school." 

"If could pillow. more students to get to know how this 
clasj3 is put together." 

.This last cdrament probably referred to the circumstance 
that Aviation students originally were assigned to the NEP-2 * 
project l?y their counselorij, and students who might want to 
avail themselves of the prcigram did not know about it. .Two 
students joined the project \in May, top late to be. retested', 
because they had heard about it and felt that tlhey could 
do better work in the NEP-2 classes. 

Most of the critical comments from Aviation studeritfe 
were contributed by members of the sophomoreT reading group. 
In response to the question, How^ could th.is program be 
improved? they wrote: 

" easier reading books for those who ca|v*t r^tid to 

good." • ^ ^ ^ 

"I trfink this class could do other things than iust 
read." ^ . 

" — have better reading selections, having them not 
so boring. " 

"They should have reading games." 

"By doing more oral words, not' just those little 
booklets," 

I ' 

These comments suggested some dissatisf action with the class, 
particularly with its materi^ils; but also reflected an impli- 
cit commitment to the task ^f improving reading skills. 

ERIC [34 ; 
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Student Questionnaires in Byron/PPC and in Long Beach 
were completed at intervals throughout the study and provided 
snapshots of the programs in these two sites. 

The particular atmosphere of the detention site was 
reflected in many of the comments of Byron/PPC students. 
For example, one such student wrote: "I think that I can 
learn a lot more out (in?) of this^ program than I can on 
the outside school." Several of the Byron/PPC students 
expressed a desire for more conventional schooling in such 
comments dn how the program o^ould be improved as: 

"Learn more from the teacher, not a pamphlet," and 

"Get rid of the carels." 

Thes^ comments were similar to those of students in other 
sites who wantejar-a>^onventidnal school experience. There 
was some indi^tionj also, that carrels have a negative ^ 
connotatioFT for ^ome students.! 

Another Byron/PPC- student commented "It's not the school 
that has to be improved. It's me. I got to start doing my 
work." This comment suggested that the student was 'becoming 
ccmmited to the academic task* or .at least, hoped that who- - 
ever read his comment would interpret it in* this* light. * 



More often than in other si\es, comments from students 
in Long Beach expressed explicit criticisms of the physiaal 
setup: too small, too little furniture, the pay -phone, 
and the like. The idea that improvement could be achieved, 
primarily through better student participation, or coiranit- 
ment — expressed by students in each site — was expressed in 
Long Beach by two- LC-3 students. One wrote that the* pro- 
gram could be improved, 

"by spending a little more time oft making everyone do 
a little more work because we're in here to get a high 
school education. " 



The other wrote, 

"By students coming to the Center to try to learn 
, instead of doing nothing." 

Much the\aine thought, related to equipment, was expressed 
by the afeu^ent who commented: 

"Bif taking the pooly table out, and other games." 

comments such as these could serve as useful . feedback to NEP-2 
Staff when, as in the case of Byron/PPC and Long Beach, 
they were registered before the program ended. 

Effectiveness of Beginning Reading proarain 

In the study of NEP-1 it was found that Beginning 
Reading was the weakest part of the Readiyig Program'. In 
an effort to strengthen this part of the program, the 
Graham Associates substituted the Sullivan Associates 
Pr ogrammed Reading for Adults for the Sullivan Associates 
Programmed Reading series which had been designed for young 
children. NEP-2 results were significantly better than 
NEP-1 results, in that 50 percent of the' students who were 
tested twxce made a gain^of .4 grades or more. These resylts 
were still poorer than those students who entered the NEP-2 
program at one of the Graded Reading Levels (sete Table 22). 
It should be noted that because of regres'sion^^ovrard the 
meaii,low scores tend to increase and high sc6|es^o decrease 
due to chance alone. The "true" differ<n^s are probably 
greater than shown. in future develoj^ihtht> of the NEP-2 
program additional attention needs to be given to strengthen- ~ 
ing the Beginning Reading Component. 

Svtmmarv 

Improvements in reading and math skills, indicated by 
retests, provided solid evidence that NEP-2 resulted in sub- 
stantial academic gains for students of widely varying char- 
acteristics. Across the board, NEP-2 students averaged a 
gain of .9 grades in reading and .7 in math during their first 
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three months in the program. These results are similar to 
those achieved in NEP-1. 



Table 22 Gains and Losses on Reading Test, 1st Retest, 
^ by Reading Program 







Beginning Reading 
N=40 


Graded Reading 
Nx=164 


^ a 
Gam 


•< 


/50% 


68%. 


No change 




43 • ^ 


17 


Loss 




8 


15 


Total 




101% 


100% 



a. A "gain" is defined as increase- in test scores of 
•4 grades between 1st and ^nd administration. "No change" 
is a change score between +.3 to' -.3. A loss is decrease 
of .4 or more. • 

Multiple retest results indicated that, except in Byron/ 
PPC, : .academic progress was maintained in subsequent test/ 
vj|etest periods. Results in Byron/PPC, a declininq rate 
V of ;^ehiev^ment between the first and second retest, suggested 
-vj that 'students in extended detention pose particularly diffi- 
■^cult problems of academic motivation and performance. 

Solid evidence for the effectiveness of the NEP-2 
"•^ program was provided by the two NYC-2 programs. Long Beach and 
Spokane. Average progress during the first three months of" 
-participation was almost one grade level for both programs^ 
with an additional one half of a grade for the second three 
month period. In Long Beach, the only program which was able 
to test students a third tim^e, the rate of progress continued 
with a littJ^ over a half year gain durihg the third three ' 
month peri^od. The students who participated in the program 
for nine months, and thus were tested three times, gained a 
spectacular 1.9'grades in reading and 2.2 grades in math. 

Another possible measure of program effectiveness is 
its holding power. This measure is obviously not relevant 
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to Byron/PPC because attendance was compulsori^ as long as the 
youth was confined to the detention center, and only mar- 
ginally relevant to Pacoima. In both Long Beach and Spokane 
the NEP-2 demonstrated good holding power. Students who 
left the program before^being retested left the program 
primarily because they had completed high school, passed the 
GED, or had obtained a job. Only about- 12 percent of thi 
total sample left NEP-2 because they lost interest; were 
ejected, or were terminated from the NYC without getting a 

The two NYC-2 programs were also^^ceptionally success- 
fulss^n helping the students complete high school or p^ss the 
GED with the percentages ranging from about 43 percent in 
Long Beach to about 52 percent in Spokane, of those stu- 
dents who were no longer enrolled in NEP. This high rate of 
success was due in large part tcr the axrangements made with 
local school authorities for crediting of completed NEP 
^ units toward a high school diploma. 

In this study, NEP-2 was found to be an effective edu- 
cational component in a variety of programs concerned with 
academic underachievers.^ The curriculum changes made in 
NEP-2, based on experience in NEP-1, were found to increase 
the effectiveness of NEP-2 compared with NEP-1. The program's 
impact could be increased even more by strengthening the Be- 
ginning Reading Program and by developing more effective 
long term motivational strategies. In some programs, parti- 
cularly Long Beach and Spokane, it was evident that NEP-2 
was successful in keeping a large proportion of the students 
actively engaged in improving their academic skills for a 
considerable period of time. There were others, however, 
whose interest decreased after several months of participation, 
the most dramatic example being the juvenile detention facil- 
ity at which the second retest scores actually decreased 
compared with 'the initial test. While improvements can be 
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made in the motivational^ aspects of the -iJEP program, it still 
has greater ability to motivate students and d^onstrate 
improvements in acaflemic skills than do other eoxicational 
programs which have been studied by researchers. i 



APPENDIX A 

descript'ion of t4e new education PROGRT^ (NEP) 



The following description is taken from Graham Associates 
.report on their demonstration grant. 



The New Education Program, as noted, is based on the Job 
Corps Programmed Learning System, and covers three broad. sub- 
ject matter areas: reading, mathematics, and advanced general 
education (i.e., grammar, literature, natural science, social 
studies, and mathematics) . " - 

„ It is this system, even more than the specific materials • 
used in the three academic areas, which, in the jtidgement of 
Grahson Associates, has made the New Education Program unique- 
ly successful in meeting the needs of manpower training pro- 
gram clients and other students with a history of school 
failure. ^ 

Following is a discussion of the major characteristics 
Of the Job Corps/New Education Program system. 
A. Individualized Instruction Format 

The goal of any educational progrcim is, of course, to 
best meet the individual Heeds of its students. In a tradi- 
tional school setting^ sheer student numbers and lack of 
individualized materials often prevent teachers from achiev- 
ing this goal. Students who are unable to respond positively 
to grouping or other traditional classroom techniques often 
fall far behind in the primary grades and suffer from severe 
basic skill deficiencies by the time they have completed ele- 
mentary school. This lack of success engenders loss of self- 
con fidencfe, and such students eventually experience great 
difficulty coping with learning situations in general, and 
with peer grot^p pressures in .particular. Most students in 
manpower programs and related settings have become education- 
ally disadvantaged in this manner. Upon enrollment, these 
students view the NEP at best as a "last chance," and at 
worst, as "just another school." Fortunately, the curricu- 
lum has been specifically designed to overcome these problems. 
The success/ of the format can, in a large part, be attributed 
not only to an individualized presentation of materials, but 
also to an overall system of imp lenient at ion which facilitates 
positive learning experiences for each student, regardless 
of his or her initial skii;L level. Three characteristics of 
the program best illustrate this point: 
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1. . Diagnostic/Prescriptive Technique 

'Before beginning wo^dc in the various academic areas^ each 
student is given diagnostic tests which effectively identify 
skill deficiencies or information gaps. From the diagnosis 
there are explicit steps leading to the proper prescriptive 
materials. The structujc^ of this diagnosis and placement 
procedure has distinct advantages for the student. Once 
testing has been completed, the student immediately skips 
t^er any areas in which he has exhibited competence* Dupli- 
(cation of work on skills already possessed is thus eliminated. 
Moreover, s|Lnce credit for such achievement is built into the 
pr9gram, the student is rewarded for whatever skill level he 
has been able to. demonstrate. This initial recognition has 
provided many students with a much-needed positive orienta- 
tion toward their work. 

The process of identifying skill deficiencies has long 
been part of the education process, but few diagnostic tools 
have tol^ the teacker precisely where to go from there. The 
availability of ^^Jioncise diagnostic/prescriptive procedure 
is therefore a sL^fxficant advantage of the New, Education 
Program. ^ 

Since the diagnostic tests were created for. these study 
materials, and test results are keyed to individual;Lzed stu- 
dent assignments, the program makes it unnecessary for the 
teacher to search for or develop specialized lessons for 
each student. Freed from this time-consuming demand, the , ^ 
teacher is able to devote his or her energies to a basics^^ly^ 
tutorial approach. Such an approach is particularly impor-;^'l0v, 
tant because of the many learning difficulties and widely 
varied skill levels present among students in manpower or 
similar programs. 

2. Student-Centered Approach 

Once the student has been placed, he is able to proceed 
with a great deal of autonomy. Since every student works with 
materials geared to his or her own needs, dependence on the 
progress of other students is eliminated. As advancement is 
made in each academic area, the structure of the system 
continues to promote this independence. Within each level, 
frequent self-administered progress checks allow the s'tudent 
to recognize personal* successes, and facilitate the setting 
of reasonable goals. Such reinforcement engenders self- 
confidence by permi1:ting the student to take responsibility 
for his or her own actions* Thus, by Emphasizing feelings of 
capability and personal accomplisl^ent^ the structure of the 
program itself generates self -motivation, and diminishes 
peer group pressure. 

The net result is a very positive classroom atmosphere 
whi^h optimizes chances of continuing student progress. 

3. Open Entry /Exit 

The development of curricula which will adequately meet 
the needs of educationally disadvantaged students is a major 
concern in current secondary education. More and more, public 
school administrators are seeing the need for programs which 
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can accept students at any time, immediately provide, them with 
appropriate courses of study, and release them purely in 
accordance with individual readiness. Meeting these criteria 
ha^ always been a high priority in schools related to manpower 
pro^gr^s and correctional facilities. Because the NEP curri- 
culum is completely open-ended. It is ideally suited for use 
at such educational sites. Student entry, advancement, and 
exit are not dependent on any designated time or school-year 
schedule. This characteristic of the system solves the kind 
of problems often associated with the arrival of a new student 
in the middle of the traditional school semester. Individual 
programming eliminates pressures on such a student to "catch 
up." Furthermore, the format permits more positive kinds of 
motivation than adherence to universcil schedules or fixed 
"graduation deadlines," since completion dates may .vary in 
accordance with each student's abilities and comfortable rate 
of progress. 

In this connection, academic lessons in all curricular 
areas* are presented in small units, in check-list forniat. 
This allows for very short-term goal setting and frequent 
success reinforcement, both strong motivational factors. in 
progrcuns geared to the needs of stu*3ents who have rarely e^f^ 
perienced success in school. This feature also insures that 
the teacher will have contact with each student at very fre- 
quent intervals to check progress and provide one-to-one 
instruction.; 

B. Adaptable to New Materials 

A major strength of the Job Corps/NEP System is its 
flexibility with regard to the assimilation of "new" materials 
in all academic areas. Excellent selections are frequently 
available from. outside resources, and creative teachers in- 
evitably bring along a variety of educational tools which they 
have used successfully in^ the past. With some time set aside 
for levelization and coordination, such materials can easily 
be built right into the existing system. This characteristic 
permits the kind of natural growth that is essential to the 
continuing success of any academic program. 

C . Easily Understood System and Format 

Many otherwise progressive educational programs are so 
complex that it may take months for new teachers to adapt to 
them. Obviously, a system which preplexes even the teacher 
will certainly be confusing to the student. Such a situation 
is particularly frustrating to students who have already had 
many negative classroom experiences. Fortunately, this is 
not the case with the New Education Program. The program has 
been thoughtfully designed and includes thorough and explicit 
training materials. As a result, the administration and im- 
plementation process can be learned in an extremely short time. 
Each academid component is accompanied by a comprehensive 
manual. Witjli\these as guides and with the assistance pf a 
skilled traittfeV, it is feasible to have a school fully opera- 
tional during tn^ second week of staff familiarization. Stu- 
dents, as well, li^e no difficulty adjusting to the program. 

I. 
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Most are able to proceed with a workable understanding of the 
format as ^'oon as initial placement is completed. 

D. Pre-DeHi^e loped Record Keeping System 

The t'horough record keeping system developed for the cur- 
riculum is of great benefit to both teacher and student. Each 
academic component has a specifically designed form for re- 
cording student progress . These forms are always available 
to the student so that he can revi^ew .acg^omplishments and plan 
future work. The -teachter u,se^ th^^^efeorded information for 
individualized lesson planning, as a counseling aid, and for 
administrative reporting. The fprrtia must therefore be kept 
up to date for the system to operate effectively. 

E. Readily Accepted for Credit 

Because of its staructure, thoroughness ,^ and academic 
content, the New Et^ucation Progrcim has been fully accepted by 
School districts at all experimental sites. Curriculum 
specialists from various districts have excunined each phase 
of the program. On the basis of their reports, a relationship 
has been developed with the local school district at each NEP 
site^ whereby NEP students are able to receive regular high 
school credits and even the diploma itself, strictly through 
participation in the NEP, and without the need to take tests 
or complete other assignments extrinsic to the New Education 
Program. This is particularly meaningful since most "alterna- 
tive education programs" never receive official accreditation. 
The high school equivalency certificate (GED) has therefore 
been the only possible form of completion offered through 
these programs. Accreditation, however, gives the student 
emother choice with regard to his or her educational objec- 
tives. 

Under the structure developed by Graham Associate?, a 
student can either prepare for the GED, or receive units 
toward a high school diploma. The real prospect of graduation 
from high school has proven to be the single greatest motiva- 
ting factor at those NEP sites serving school-age youth and 
young adults. 

F . Relatively Inexpensive 

The overall cost of materials is of particular impor- 
tance to admiiaistrators who wish to set up schools. Graham 
Associates has found the Job Corps Curriculum to be most rea- 
sonable in this regard. 
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APPENDIX B 
WORK-RELEVANT ATTITUDES 



Responses to items 1-7 were structured in a 4-point 
scale: l=strongly agree; 2=soinewhat agree; 3=somewhat disa- 
gree; 4=strongly disagree. Responses to items 8-11 were 
structured in a 4-point scale: l=almost always; 2=usually; 
3=sometimes; 4=almost never. 

1. Becoming a success is mainly a matter of luck; hard 
work doesn't help very much. 

2. The wise person lives for today and lets tomorrow 
take car6 of itself. 

3. You feel that you have little influence over the 
things that happen to you. 

4. A high school education is worth all the time and 
effort it requires, 

5. Most people cannot be trusted, 

6. You are generally enthusiastic about new plans. 
%* 

7. Most bosses have it in for you and give you a hard 
time. 

8. You feel happy. 

9. You get even with people who wrong you as soon as 
you can. 

10. During your spare time, you have something that 
you like doing, 

11. You expect to do well in things you try to do. 

12. Would you gay that your chances of becoming a res- 
pected and law-abiding member of your community are: 
excellent, reasonably good, not very good, or very 
unlikely? (l=excellent, 4=veafy unlikely) 
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